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DESCRIPTION 



VIDEO IMAGE TYPE DETERMINATION SYSTEM, VIDEO IMAGE 
PROCESSING SYSTEM, VIDEO IMAGE PROCESSING METHOD AND VIDEO 

IMAGE PROCESSING PROGRAM 



Technical Field 

The present invention relates to a technique to 

process a video image of a mobile camera. Particularly, 
10 the present invention relates to a video image processing 
system, a video image processing method and a video image 
processing program for determining the type of the video 
image contents and processing the video image. The 
present invention also relates to an video image type 
15 determination system, a video image type determination 
method and a video image type determination program for 
determining the type of the video image contents. The 
present invention further relates a server and a terminal 
of the video image processing system. 



Background Art 

A mobile camera such as a ubiquitous camera is always 

carried by a photographer or mounted on a vehicle. In this 
case, video images are not intentionally taken by the 
photographer, but sequence video images of ordinary 
actions of the photographer are unintentionally taken. 
Therefore, the video images taken by the mobile camera 
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often contains scenes which are not considered as important 
to a user. It is demanded to realize a system for 
effectively browsing the video images taken by the mobile 
camera . 

5 Japanese Laid Open Patent Application JP-P2000- 

92386A discloses a browsing system for video images of a 
mobile camera . Fig.l is ablockdiagram showing an example 
of a configuration of the browsing system for the video 
images of the mobile camera according to conventional 

10 technique. As shown in Fig.l, this browsing system 
includes a video image replay section 902, a current 
position control section 903, an area importance level 
control section 90.4, a video image omission section 905 
and an video image display section 906. The video image 

15 replay section 902 replays the video images of the mobile 
camera. The current position control section 903 controls 
where the current position of the replayed video image is 
located in a moving space. The moving space is divided 
into a couple of areas, in which the importance level is 

20 provided for each area. The area importance level control 
section 904 controls how important the respective areas 
are and calculates the importance level of the area to which 
the current position belongs. The video image omission 
section 905 omits the video image in accordance with the 

25 importance level of a unit area when the video image is 
replayed. The video image display section 906 displays 
the video images which is normally replayed or replayed 
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through the omission. 

Another browsing system is also disclosed in "T. Ueda 
et al. , "Digest Creation of Video Data recorded by Wearable 
Camera using Location and Geographical Information", 
5 Technical Report of the Institute of Electronics, 

Information and Communication Engineers, Vol.101, No. 193 
(DE2001-101) , pp. 175-182, July 2001". According to this 
video image processing system, the importance level of a 
scene is calculated by a distance and a direction between 

10 a photographing position and a landmark so that a scene 
whose importance level is higher than a predetermined 
threshold value is exclusively extracted and provided. 

According to . the above mentioned conventional 
browsing system, the importance level of the video image 

15 is detected on the basis of the photographing position. 
Consequently, a scene with the high importance level is 
exclusively extracted, and the replay speed is changed in 
accordance with the importance level. 

In the case of using the ubiquitous camera and the 

20 like, the video image is not intentionally taken by the 
photographer, but sequence video image of the ordinary 
actions of the photographer are unintentionally taken. 
Therefore, when the unedited video image is replayed, a 
person browsing the video image may have an unpleasant 

25 impression. For example, in the video image which was 
taken when the photographer significantly changed a line 
of sight leftward and rightward or when a car was turning 
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to right or left, there is a large sway of the video images 
between left and right. Such a video image scene may give 
an unpleasant impression to the browsing person when it 
is replayed at high speed. There is also a case that a 
5 scene having no variations such as a traveling scene in 
traffic congestion makes the browsing person feel bored 
when it is replayed at low speed. 

An important scene in the video image by the mobile 
camera is not determined only by a relative position 

10 against an object. Since a photographic device itself is 
moving, there is a case that moving information itself has 
a profound relationship with the important scene. Because 
actions such as turning and making a stop on the street 
contain an intention of a walker or a car driver, the 

15 importance level of the video image is increased in the 
case of turning and making a stop on the street. 

However, in the above described conventional 
browsing system, the importance level is determined simply 
on the basis of the distance/direction between the 

20 photographing position and the landmark. Therefore, it 
is impossible for the conventional browsing system to 
appropriately determine a detailed type of the video image 
scene. It is impossible to appropriately replay the video 
image in accordance with the type of the video image scene 

25 either. 

Moreover, the criteria of the importance level in the 
moving video image is changed based on the purpose to browse 
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the video image by the browsing person. Since the criteria 
to determine the importance level is fixed in the 
conventional browsing system, it is difficult to 
correspond to the change of the purpose by the browsing 
5 person. For example, when the purpose is to confirm a 
route to reach a destination, the video image of a whole 
route is important and a scene to turn the corner and the 
like is particularly the most important. Meanwhile, when 
the purpose is to review the video image of a drive in the 

10 past, the landmark such as a mountain and a building which 
were along the road is important. 

The following techniques are known as conventional 
techniques related to the process of the video images. 
An video image processing device disclosed in 

15 Japanese Laid Open Patent Application JP-P2 0 0 2- 1 4 2 1 8 9A 
includes an input means, an evaluation means and a 
processing means. The input means inputs a data stream 
having moving video image data. The evaluation means 
divides the moving video image data into a plurality of 

20 scenes and evaluates the moving video image data in the 
respective scenes according to a plurality of conditions 
which are mutually different. The processing means 
selects the scenes based on the evaluation result by the 
evaluation means. 

25 Japanese Laid Open Patent Application JP-P2002- 

271733A discloses a device to generate a digested video 
image of a soccer game. This digest generating device 



- 6 - 



divides the video image of a soccer game into a plurality 
of time zones and determines the state of each team 
(offensive state, defensive state, etc.) in each time zone 
to generate information indicating the progress of a match. 
5 The digest generating device then extracts the video image 
scene by using the generated information and the importance 
level . 

Japanese Laid Open Patent Application JP-P2002- 
330393A discloses a video image digest generating method 

10 to determine importance of significance at a point of time 
on the video image of a program and dynamically calculate 
the importance level while receiving information additive 
to the program. Japanese Laid Open Patent Application 
JP-P2003-877 12A also discloses a method for generating a 

15 digested sports video image which is capable of capturing 
a progress of the match and determining the importance 
level of phenomena. 

Japanese Laid Open Patent Application JP-P, Heisei 
08-95596A discloses a method capable of grasping the outer 

20 shell and the atmosphere of the video image and sound in 
a short period of time by using sound information. This 
method includes step for inputting video image information 
composed of video image information and sound information, 
step for extracting various kinds of feature variables from 

25 the sound information among the inputted video image 
information, step for processing the video image 
information based on the extracted feature variables, and 
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step for outputting the generated video image information 
by the processing. 

Disclosure of Invention 

5 An object of the present invention is to provide a 

video image type determination system, a video image type 
determination method and a video image type determination 
program which are capable of determining the type of a video 
image scene. 

10 Another object of the present invention is to provide 

a video image processing system, a video image processing 
method, a video image processing program, which are capable 
of processing a video image by using a processing method 
corresponding to the type of the video image scene which 

15 is determined based on the type of the video image scene, 
and the server and the terminal of the video image 
processing system. 

In a first aspect of the present invention, a video 
image type determination system includes a video image 

20 input section which inputs a video image photographed by 
a mobile video image photographing device; a moving feature 
variable obtaining section which obtains a moving feature 
variable indicating a feature of the video image 
photographing device in a state of moving; and a video image 

25 type determining section which determines a type of a video 
image scene included in the video image on the basis of 
the moving feature variable. 
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In a second aspect of the present invention, a video 
image processing system includes a video image input 
section, a moving feature variable obtaining section, a 
video image type determining section and a video image 
5 processing section. The video image input section inputs 
a video image photographed by a mobile video image 
photographing device. The moving feature variable 
obtaining section obtains a moving feature variable 
indicating a feature of the video image photographing 

10 device in a state of moving. The video image type 

determining section determines a type of a video image 
scene included in the video image on the basis of the moving 
feature variable. The video image processing section 
determines a processing method of the video image on the 

15 basis of the type of the video image scene determined by 
the video image type determining section, and processes 

the video image on the basis of the determined processing 

t 

method . 

The video image processing system may further include 
20 a display section which displays the video image which is 
processed by the video image processing section. It is 
therefore possible to reproduce and display the processed 
video image. 

The moving feature variable obtaining section may 
25 include a speed input section which obtains a moving speed 
of the video image photographing device, a first position 
input section which obtains a photographing position of 
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the video image photographing device, and a moving feature 
variable calculating section which calculates a moving 
feature variable corresponding to the video image scene 
on the basis of the photographing position and the moving 
5 speed. 

The video image processing system may further include 
a route information memory section which stores route 
information, The route information is property 
information of the route capable of passing during the move. 

10 The moving feature variable calculating section 

calculates the moving feature variable corresponding to 
the video image scene on the basis of the route information, 
and the photographing position and the moving speed of the 
video image photographing device. The moving feature 

15 variable can be easily obtained by using the route 
information which was memorized in advance. 

The route information may include at least any one 
of a route position, type, a number of lanes, a position 
of an intersection, a position of a junction, and existence 

2 0 of a signal . 

The moving feature variable may include at least any 
one of a deviation variable between a current position of 
the video image photographing device and a predetermined 
route, a running speed, and a running straight variable. 

25 The video image processing system may further include 

a landmark feature variable obtaining section which 
obtains a landmark feature variable indicating a feature 
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of a landmark existing within a viewing angle of the video 
image. The video image type determining section 
determines the type of the video image scene on the basis 
of the landmark feature variable and the moving feature 
5 variable. In this case, not only the moving feature 
variable but also the landmark feature variable are 
employed, which enables to determine the type of the video 
image scenes further more. 

The landmark feature variable obtaining section may 

10 include a direction input section which obtains the 

photographing direction of the video image photographing 
device, a second position input section which obtains the 
photographing position of the video image photographing 
device, a landmark information memory section which stores 

15 landmark information including property information of 
the landmark, and a landmark feature variable calculating 
section. The landmark feature variable calculating 
section calculates the landmark feature variable 
corresponding to the video image scene on the basis of the 

20 landmark information, the photographing position, and the 
photographing direction. In this case, the landmark 
feature variable can be easily obtained by using the 
photographing direction and the photographing position. 
The landmark information may include a position and 

25 a form of the landmark. The landmark feature variable may 
include at least any one of a size of the landmark on a 
screen and a deviation variable from a screen center. 
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The video image type determining section may 
determine the type of the video image scene by determining 
whether or not the moving feature variable and the landmark 
feature variable are larger than threshold values. The 
5 type of the video image scene can be easily determined by 
performing a threshold value determination. The 
threshold values with respect to the moving feature 
variable and the landmark feature variable may be changed 
depending on a usage purpose. 

10 The video image type determining section may 

calculate an importance level of the video image scene on 
the basis of at least one of values among the moving feature 
variable and the landmark feature variable, and determine 
the type of the video image scene when the calculated 

15 importance level is larger than a threshold value. It is 
therefore possible to perform an video image process 
exclusively for the important video image scene. 

The video image processing section may exclusively 
process the video image of a specific video image scene. 

20 The display section may display a map including a position 
in which the video image is photographed while displaying 
the video image. 

The display section may include a user interface for 
a user to set and input the usage purpose of the video image. 

25 The usage purpose of browsing the video image means, for 
example, a drive simulation or sightseeing drive guidance. 
Moreover, the user interface is realized by displaying a 
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slide bar to set and input the usage purpose on the display 
section . 

The type of the video image scene may include at least 
one of a turning corner scene, a landmark scene, a traffic 
5 congestion scene, a signal waiting scene, and other scene. 
In this case, the video image processing section may 
process the video image so as to perform a slow replay in 
the video image scene which is determined as the turning 
corner scene, processes the video image so as to display 

10 a ticker of the landmark information in the video image 
scene which is determined as the landmark scene, processes 
the video image so as to delete the video image scene which 
is determined as the traffic congestion scene, processes 
the video image so as to delete a video image scene which 

15 is determined as the signal waiting scene, and processes 
the video image so as to perform a high-speed replay in 
the video image scene which is determined as the other 
scene . 

In a third aspect of the present invention, a server 
20 of a video image processing system which processes a video 
image photographed by a video image photographing device, 
is provided. The server includes a landmark information 
memory section, a landmark feature variable calculating 
section, a route information memory section to memorize 
25 the route information, a moving feature variable 

calculating section, a video image type determining 
section, a video image processing section, and a 
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server-side transmission section. The landmark 
information memory section memorizes landmark information 
including property information of a landmark. The 
landmark feature variable calculating section calculates 
5 a landmark feature variable corresponding to a video image 
scene on the basis of the landmark information, and a 
photographing position and a photographing direction of 
the video image photographing device received from a 
terminal. The route information memory section memorizes 

10 route information. The moving feature variable 

calculating section calculates a moving feature variable 
corresponding to the video image scene on the basis of the 
route information, and the photographing position and the 
moving speed of the video image photographing device 

15 received from the terminal. The video image type 

determining section determines a type of the video image 
scene on the basis of the landmark feature variable and 
the moving feature variable. The video image processing 
section determines a processing method of the video image 

20 on the basis of the type of the video image scene, and 
processes the video image on the basis of the determined 
processing method. The server-side transmission section 
transmits the video image processed by the video image 
processing section to the terminal via a communication 

25 network. 

In a forth aspect of the present invention, a server 
of a video image processing system which processes a video 
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image photographed by a video image photographing device, 
is provided. The server includes a landmark information 
memory section, a landmark feature variable calculating 
section, a route information memory section to memorize 
5 route information, a moving feature variable calculating 
section, a video image type determining section, and a 
server-side transmission section. The landmark 
information memory section memorizes landmark information 
including property information of a landmark. The 

10 landmark feature variable calculating section calculates 
a landmark feature variable corresponding to a video image 
scene on the basis of the landmark information, and a 
photographing position and a photographing direction of 
the video image photographing device received from a 

15 terminal . The route information memory section memorizes 
route information. The moving feature variable 
calculating section calculates a moving feature variable 
corresponding to the video image scene on the basis of the 
route information, and the photographing position and thee 

20 moving speed of the video image photographing device 
received from the terminal. The video image type 
determining section determines a type of the video image 
scene on the basis of the landmark feature variable and 
the moving feature variable. The server-side 

25 transmission section transmits the type of the video image 
scene to the terminal via a communication network. In this 
case, the amount of communication on the communication 
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network can be substantially reduced in comparison with 
the case to transmit the video image to a server. 

In a fifth aspect of the present invention, a terminal 
of a video image processing system which processes a video 
5 image photographed by a video image photographing device, 
is provided. The terminal includes a video image input 
section which inputs the video image; a direction input 
section which inputs a photographing direction of the video 
image photographing device; a position input section which 

10 inputs a photographing position of the video image 

photographing device; a speed input section which inputs 
a moving speed of the video image photographing device; 
a terminal-side transmission section which transmits the 
video image, the photographing direction, the 

15 photographing position and the moving speed to a server 
that processes the video image via a communication network; 
and a video image display section which displays the 
processed video image received from the server. 

In a sixth aspect of the present invention, a terminal 

20 of a video image processing system which processes a video 
image photographed by a video image photographing device, 
is provided. The terminal includes a video image input 
section which inputs the video image; a direction input 
section which inputs a photographing direction of the video 

25 image photographing device; a position input section which 
inputs a photographing position of the video image 
photographing device; a speed input section which inputs 
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a moving speed of the video image photographing device; 
a terminal-side transmission section which transmits the 

■ 

photographing direction, the photographing position and 
the moving speed to a server that determines a type of a 
5 video image scene via a communication network; a video 
image processing section which determines a method to 
process the video image on the basis of the type of the 
video image scene received from the server, and processes 
the video image on the basis of the determined processing 

10 method; and a video image display section which displays 
the video image processed by the video image processing 
section. In this case, the amount of communication on the 
communication network can be significantly reduced in 
comparison with the case to transmit the video image to 

15 the server. 

In a seventh aspect of the present invention, a video 
image type determination method includes (A) inputting a 
video image photographed by a mobile video image 
photographing device; (B) obtaining a moving feature 

20 variable indicating a feature of the video image 
photographing device in a state of moving; and (C) 
determining a type of a video image scene included in the 
video image on the basis of the moving feature variable. 
In a eight aspect of the present invention, a video 

25 image processing method includes (A) inputting a video 
image photographed by a mobile video image photographing 
device; (B) obtaining a moving feature variable indicating 
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a feature of the video image photographing device in a state 
of moving; (C) determining a type of a video image scene 
included in the video image on the basis of the moving 
feature variable; and (D) determining a processing method 
5 of the video image on the basis of the type of the video 
image scene, and processing the video image on the basis 
of the determined processing method. 

The video image processing method may further 
includes (B 1 ) obtaining a landmark feature variable 

10 indicating a feature of a' landmark existing within a 

viewing angle of the video image. In this case, the type 
of the video image scene is determined on the basis of the 
landmark feature variable and the moving feature variable 
in the above (C) step. 

15 In a ninth aspect of the present invention, a video 

image type determination program includes code that, when 
executed, causes a computer to perform (A) inputting a video 
image photographed by a mobile video image photographing 
device; (B) obtaining a moving feature variable indicating 

20 a feature of the video image photographing device in a state 
of moving; and (C) determining a type of a video image scene 
included in the video image on the basis of the moving 
feature variable. 

In a tenth aspect of the present invention, a video 

25 image processing program includes code that, when executed, 

causes a computer to perform: (A) inputting a video image 
photographed by a mobile video image photographing device; 
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(B) obtaining a moving feature variable indicating a 
feature of the video image photographing device in a state 
of moving; (C) determining a type of a video image scene 
included in the video image on the basis of the moving 
5 feature variable; and (D) determining a method to process 
the video image on the basis of the type of the video image 
scene, and processing the video image on the basis of the 
determined processing method. 

The video image processing program may further include 

10 code that, when executed, causes the computer to perform 

(B 1 ) obtaining a landmark feature variable indicating a 
feature of a landmark existing within a viewing angle of 
the video image. In this case, the type of the video image 
scene is determined on the basis of the landmark feature 

15 variable and the moving feature variable in the above (C) 
s t ep . 

According to the present invention, it is possible 
to determine the type of the video image scene on the basis 
of the moving feature variable. The present invention 
20 also enables to process the video image by using the 

processing method corresponding to the determined type of 
the video image scene. 



Brief Description of the Drawings 

25 Fig.l is a block diagram showing an example of a 

configuration of a browsing system for a video image of 
a conventional mobile camera; 
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Fig. 2 is a block diagram showing an example of a 
configuration of a video image processing system according 
to a first embodiment of the present invention; 

Fig. 3 is a block diagram showing an example of a 
5 configuration of a landmark feature variable obtaining 
section; 

Fig. 4 is a block diagram showing an example of a 
configuration of a moving feature variable obtaining 
section; 

10 Fig. 5 is a block diagram showing an example of a 

configuration of a video image processing system according 
to a present embodiment of the present invention; 

Fig. 6 is a block diagram showing an example of a 
configuration of a video image processing system according 
15 to a third embodiment of the present invention; 

Fig. 7 is a flowchart showing an example of an 
operation of a video image processing system according to 
the present invention; 

Fig. 8 is a diagram to explain data treatment of a 
20 video image processing according to the present invention; 

Fig. 9 is a diagram to explain data treatment of a 
video image processing according to the present invention; 

Fig. 10 is a diagram to explain data treatment of a 
video image processing according to the present invention; 
25 Fig. 11 is an explanatory diagram showing an example 

of a method for calculating straightness ; 

Fig. 12 is an explanatory diagram showing an example 
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of setting information in the video image processing 
treatment; 

Fig. 13 is a conceptual diagram showing an example of 
a display screen; 
5 Fig. 14 is a flowchart showing an operation of the 

video image processing system according to the present 
invention ; 

Fig. 15 is a diagram to explain data treatment of a 
video image processing according to the present invention; 
10 and 

Fig. 16 is a conceptual diagram showing another 
example of the display screen. 

Best Mode for Carrying out the Invention 

15 (First Embodiment) 

A first embodiment of the present invention will be 
explained below with reference to attached drawings. 
Fig. 2 is a block diagram showing an example of a 
configuration of a video image processing system according 

20 to the first embodiment of the present invention. As shown 
in Fig. 2, the video image processing system includes a 
video image obtaining section 1 to obtain the video image, 
a landmark feature variable obtaining section 2, a moving 
feature variable obtaining section 3, a video image type 

25 determining section 4, a video image processing section 
5, and a display section 6. 

Fig. 3 is a block diagram showing an example of a 
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configuration of the landmark feature variable obtaining 
section 2. As shown in Fig. 3, the landmark feature 
variable obtaining section 2 includes a direction 
obtaining section 201 to obtain the direction of the video 
5 image photographing device, a position obtaining section 
202 to obtain the position of the video image photographing 
device, a landmark information memory device 203 to 
memorize landmark information, and a landmark feature 
variable calculating section 204 to calculate a landmark 

10 feature variable on the basis of the direction which is 
obtained by the direction obtaining section 201, the 
position which is obtained by the position obtaining 
section 202 and the landmark information. 

The landmark information is property information of 

15 the landmark such as the position, height and form of the 
landmark. The landmark feature variable is also a feature 
variable to indicate a feature of the landmark in the video 
image . 

Fig. 4 is a block diagram showing an example of a 
20 configuration of the moving feature variable obtaining 
section 3. As shown in Fig. 4, the moving feature variable 
obtaining section 3 includes a speed obtaining section 301 
to obtain the speed of the video image photographing device, 
a position obtaining section 302 to obtain the position 
25 of the video image photographing device, a route 
information memory device 303 to memorize route 
information, and a moving feature variable calculating 
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section 304 to calculate a moving feature variable on the 
basis of the direction which is obtained by the speed 
obtaining section 301, the position which is obtained by 
the position obtaining section 302, and the route 
5 information. 

The route information is property information of a 
route which can be passed by the video image photographing 
device during the move, such as the route position, type, 
the number of the lanes, the position of the 

10 intersection/ j unction, and the existence of the signal. 
The moving feature variable is a feature variable to 
indicate a feature of the video image photographing device 
in the state of moving. 

The video image obtaining section 1 is realized by, 

15 for example, a data processing unit (not shown) , a program 
and an input interface (not shown) of the computer. The 
video image obtaining section 1 supplies the video image 
which is photographed by the mobile photographing device 
(video image photographing device) . The mobile 

20 photographing device is a video image apparatus such as 
a CCD digital camera and a video camera. The mobile 
photographing device changes the photographing position 
and the photographing direction based on the position and 
direction of a mobile means such as a vehicle, person, ship 

25 and aircraft . 

The landmark feature variable obtaining section 2 
calculates the landmark feature variable on the basis of 
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the direction and the position of the video image 
photographing device by which the video image is 
photographed, and information of the position and height 
of the landmark (landmark information) which is registered 
5 in the landmark information memory device 203 in advance. 

The landmark feature variable obtaining section 2 
obtains the position (a deviation variable from the screen 
center) and the size of the landmark on the screen as the 
landmark feature variable. The landmark is an object 

10 whose position and form can be described such as an 

artificial construction including a building, a bridge and 
a tower, and a natural structure including a mountain and 
a lake. If the moving position and time are already known, 
a moving object such as a train capable of being described 

15 by using a combined set of the time and position data may 
be employed as the landmark. 

A representative point of the landmark is employed 
to describe the landmark. For example, latitude, 
longitude and a height of a center of gravity of the 

20 landmark is employed to describe the landmark. For 

example, a group of data indicating the latitude, the 
longitude and the height of the position of respective 
points such as polygon for configuring the landmark may 
also be employed. 

25 The landmark information memory device 203 is 

realized by, for example, a magnetic disc device. The 
landmark information memory device 203 memorizes the 
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position, the height and the form of the landmark in advance 
as the landmark information. The landmark information 
memory device 203 may also memorize incidental information 
such as history, usage fee and name recognition level of 
5 the landmark as the landmark information in addition to 
the position, the height and the form of the landmark. 

The position obtaining section 202 is realized by, 
for example, a data processing unit, a program and an input 
interface of the computer. In this case, the position of 

10 the video image photographing device is described by using 
the latitude, the longitude and the height. The position 
obtaining section 202 supplies information of the latitude, 
the longitude and the height of the. video image 
photographing device by using, for example, a GPS (Global 

15 Positioning System) device. 

The direction obtaining section 201 is realized by, 
for example, the data processing unit and the input 
interface of the computer. The direction obtaining 
section 201 supplies the photographing direction 

20 (orientation) of the video image photographing device by 
using a magnetic compass, an electronic compass and a gyro 
sensor . 

The landmark feature variable calculating section 
204 is realized by, for example, the data processing unit 
25 and the program of the computer. The viewing angle 

informed in advance by the calculation of a focal distance 
of a camera and the size of a CCD element. The landmark 
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feature variable calculating section 204 calculates the 
direction and distance of the respective points of the 
landmark in the case of being observed from the position 
of the video image photographing device by using the 
5 position of the landmark which is registered in advance 
in the landmark information memory device 203. The 
landmark feature variable calculating section 204 
converts a relative position of the landmark into the 
position on the screen on the basis of the photographing 

10 position and the viewing angle in order to calculate the 
relative position as the landmark feature variable. The 
landmark feature variable calculating section 204 
calculates the size of the landmark on the screen as the 
landmark feature variable. 

15 The moving feature variable obtaining section 3 

calculates a moving feature variable which indicates the 
feature of the video image photographing device in the 
state of moving. The moving feature variable obtaining 
section 3 calculates a running state, straightness 

20 (running straightness) , a side trip level, and the running 
speed as the moving feature variable on the basis of the 
position and the moving speed of the video image 
photographing device, and route information which is 
registered in the route information memory device 303 in 

25 advance. 

The route information memory device 303 is realized 
by, for example, the magnetic disc device. The route 
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information memory device 303 memorizes in advance, as the 
route information, the route position, type (national road, 
private road and the like), the number of the lanes, the 
position of the intersect ion/ junction, and the existence 
5 of the signal and the like. 

The position obtaining section 302 is realized by, 
for example, the data processing unit, the program and the 
input interface of the computer. The position obtaining 
section 302 obtains, for example, information on the 

10 latitude, the longitude and the height of the video image 
photographing device by the input from the GPS. The 
position obtaining section 302 may also be equivalent to 
the position obtaining section 202 included in the landmark 
feature variable obtaining section 2. 

15 The speed obtaining section 301 is realized by, for 

example, the data processing unit, the program and the 
input interface of the computer. The speed obtaining 
section 301 supplies the moving speed of the video image 
photographing device by using, for example, a speed mater 

20 and a car navigation device. Therefore, the speed 

obtaining section 301 obtains the moving speed of the video 
image photographing device. 

The moving feature variable calculating section 304 
is realized by, for example, the data processing unit and 

25 the program of the computer. In the case of obtaining 
"running state", the moving feature variable calculating 
section 304 determines whether it is in the state of 
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stopping at the signal or the traffic congestion, the state 
of low-speed running and the state of normal running, by 
using the route information such as the moving speed of 
the video image photographing device, the route position, 
5 type (national road, private road and the like) , the number 
of the lanes, the position of the intersect ion/ junction, 
and the existence of the signal. When the route 
information is not available, the moving feature variable 
calculating section 304 performs a status determination 

10 by exclusively using the moving speed of the video image 
photographing device . 

In the case of obtaining "straightness", the moving 
feature variable calculating section 304 calculates the 
straightness on the basis of the size of an angle made by 

15 a speed vector in the successive positions. The moving 
feature variable calculating section 304 is also capable 
of performing the status determination for a state of 
turning right or left at the intersection by a threshold 
determination using the straightness and the information 

20 on the intersection position included in the route 

information. When the mobile means is a car and the like, 
the moving feature variable calculating section 304 may 
obtain the straightness by using the rotation angle of a 
handle and a wheel as well as utilizing the successive 

25 positions. 

In the case of establishing a moving route to the 
destination point by a navigation system or the like, the 
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moving feature variable calculating section 304 also 
obtains, as the "side trip level", the distance deviation 
(hereinafter indicated as a route deviation variable) 
between the current position and the route (the established 
5 moving route) of the video image photographing device. 

The video image type determining section 4 is 
realized by, for example, the data processing unit and the 
program of the computer. The video image type determining 
section 4 determines the type of the video image contents 

10 (the type of the video image scene) on the basis of the 
landmark feature variable and the moving feature variable 
in the respective video image scenes. The video image type 
determining section 4 determines the type of the video 
image scenes by performing the threshold determination 

15 respectively for the number of the landmark within the 
viewing angle, the position and size of the landmark on 
the screen in the landmark feature variable, and the 
running state, the straightness and the route deviation 
variable in the moving feature variable. 

20 The landmark feature variable obtaining section 2 is 

not necessarily a prerequisite configuration factor in the 
present embodiment. If the video image processing system 
does not include the landmark feature variable obtaining 
section 2, the video image type determining section 4 

25 determines the type of video image scenes exclusively on 
the basis of a moving feature variable which is obtained 
by the moving feature variable obtaining section 3. 
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The video image type determining section 4 may 
determine the type of the video image scene exclusively 
for an important video image scene instead of determining 
the type of all the video image scenes. In this case, the 
5 video image type determining section 4 determins the 
importance level of the video image scene on the basis of 
the "moving feature variable" and the "landmark feature 
variable". Then, the video image type determining section 
4 determines the type of the video image scene exclusively 

10 for the video image scene which is determined as important 
on the basis of the obtained importance level. 

The video image processing section 5 is realized by, 
for example, the data processing unit, the program and the 
memory device (not shown) of the computer. The video image 

15 processing section 5 determines a processing method with 
respect to the video image scene whose type is determined 
by the video image type determining section 4 in accordance 
with the usage purpose of the video image contents 
(sightseeing guidance, grasp of a drive route, observation 

20 and the like) . Examples of the "observation" include 
observation in a hospital or a factory by using a camera 
mounted on a mobile-type robot. The video image 
processing section 5 processes the video image which is 
obtained by the video image obtaining section 1 in 

25 accordance with the determined processing method 

corresponding to the usage purpose of the video image 
contents, and outputs the processed video image. 
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The usage purpose may be specified and selected by 
the user, or may be automatically selected by the 
photographing position of the video image and the extracted 
landmark . 

5 A processing method for usage purpose of the video 

image contents is set in advance. For example, the video 
image processing section 5 memorizes setting information 
of the processing method in advance. The video image 
processing section 5 may employ a general-purpose pattern 

10 of the processing method in setting the processing method, 
or may employ a pattern which is prepared or changed in 
accordance with the preference of the user. 

Particularly in a scene which is extracted for the 
reason of the landmark existing, it is effective to display 

15 the name of the landmark in a ticker in order to notify 
the user the existence of the landmark. Therefore, the 
video image processing section 5 performs a process of 
displaying a ticker on the screen. Moreover, in a scene 
which is extracted for the reason of being a turning corner, 

20 the video image processing section 5 performs a process 
of a normal or slow replay along with a process of 
displaying the direction to turn since scenery shown on 
the screen significantly flows leftward and rightward. 
The display section 6 is realized by, for example, 

25 the display device (not shown) of the computer. The 

display section 6 displays the video image contents which 
are processed by the video image processing section 5. The 
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display section 6 may synchronize and display the 
photographing position and direction on the map along with 
the video image . 

In the present embodiment, the video image input 
5 section corresponds to the video image obtaining section 
1. The speed input section corresponds to the speed 
obtaining section 301. The first position input section 
corresponds to the position obtaining section 302. The 
route information memory section corresponds to the route 

10 information memory device 303. The direction input 

section corresponds to the direction obtaining section 201. 
The second position input section corresponds to the 
position obtaining, sect ion 202. The landmark information 
memory section corresponds to the landmark information 

15 memory device 203. 

Moreover, in the present embodiment, the computer 
memory device to realize the video image processing system 
memorizes various kinds of programs in order to perform 
a process of the video image type determination and the 

20 video image processing. The computer memory device to 
realize the video image processing system, for example, 
stores the video image type determination program for 
performing a video image input process to input the video 
image photographed by the video image photographing device, 

25 the moving feature variable obtaining process to obtain 
the moving feature variable indicating the feature of the 
video image photographing device in the state of moving, 
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and the video image type determination process to determine 
the type of the video image scene of the inputted video 
image . 

Moreover, the computer memory device to realize the 
5 video image processing system stores, for example, a video 
image processing program for causing the computer to 
perform the video image input process to input the video 
image photographed by the video image photographing device, 
the moving feature variable obtaining process to obtain 

10 the moving feature variable indicating the feature of the 
video image photographing device in the state of moving, 
the video image type determination process to determine 
the type of the video image scene of the inputted video 
image on the basis of the moving feature variable, and the 

15 video image processing program to determine the processing 
method of the video image on the basis of the type of the 
determined video image scene and to process the video image 

* 

in accordance with the determined processing method. 
As described above, according to the present 

20 embodiment, the video image processing system is capable 
of determining the type of the video image scene on the 
basis of the moving feature variable and/or the landmark 
feature variable. It is also possible in the video image 
processing system to process the video image in accordance 

25 with the processing method corresponding to the type of 
the video image scene and the usage purpose. 

Moreover, since the type of the video image scene can 
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be determined according to the present embodiment, it is 
possible to determine a redundant video image scene or a 
video image scene whose viewing angle is significantly 
changed. In this case, it is possible to process a moving 
5 video image with high redundancy or a lot of changes by 
processing the high-speed replay or the slow replay for 
the respective video image scenes. According to the 
present embodiment, it is also possible to provide a 
processed video image corresponding to the usage purpose 

10 by changing the processing method to correspond to the 
respective video scenes following to the usage purpose. 
(Second Embodiment ) 

A second embodiment of the present invention will be 
explained below with reference to attached drawings. 

15 Fig. 5 is a block diagram showing an example of a 

configuration of the video image processing system 
according to the present embodiment. As shown in Fig. 5, 
the video image processing system in the present embodiment 
includes a terminal 40a and a server 50a. Fig. 5 also shows 

20 that the terminal 40a and the server 50a are connected via 
a communication network 100. The communication network 
100 is a wireless communication network in the present 
embodiment . 

The terminal 40a is a terminal carried by the person 
25 or mounted on the mobile means such as a vehicle, a ship 
and an aircraft. As shown in Fig. 5, the terminal 40a 
includes the video image obtaining section 1, the direction 
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obtaining section 201, a position obtaining section 402, 
the speed obtaining section 301 and the display section 
6. 

The video image obtaining section 1, the direction 
5 obtaining section 201, the position obtaining section 402 
and the speed obtaining section 301 are realized by a data 
processing unit (not shown) , a program performed by the 
data processing unit, an input interface (not shown) , and 
a network interface (not shown) of the terminal 40a. The 

10 display section 6 is also realized by the data processing 
unit, a display device (not shown) and the network 
interface of the terminal 40a. 

A procedure for obtaining a video image in the video 
image obtaining section 1, a procedure for obtaining the 

15 direction of the video image photographing device in the 
direction obtaining section 201, a procedure for obtaining 
the moving speed of the video image photographing device 
in the speed obtaining section 301, and a procedure for 
displaying the video image contents in the display section 

20 6 are equivalent to those of the first embodiment. A 
procedure for obtaining the position of the video image 
photographing device in the position obtaining section 402 
is equivalent to the procedure for obtaining the position 
of the video image photographing device in the position 

25 obtaining section 202 and the position obtaining section 
302 which are described in the first embodiment. 

The server 50a includes the landmark information 
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memory device 203, the landmark feature variable 
calculating section 204, the route information memory 
device 303, the moving feature variable calculating 
section 304, the video image type determining section 4, 
5 and the video image processing section 5 as shown in Fig. 5. 

The landmark information memory device 203 and the 
route information memory device 303 are realized by, for 
example, the magnetic disc device. The landmark feature 
variable calculating section 204, the moving feature 

10 variable calculating section 304 and the video image 

processing section 5 are realized by a data processing unit 
(not shown) , a program and a network interface (not shown) 
of the server 50a. The video image type determining 
section 4 is realized by the data processing unit and the 

15 program of the server 50a. 

Contents of the landmark information memorized by the 
landmark information memory device 203 and the route 
information memorized by the route information memory 
device 303 are equivalent to those of the first embodiment. 

20 A procedure for calculating the landmark feature variable 
in the landmark feature variable calculating section 204, 
a procedure for calculating the moving feature variable 
in the moving feature variable calculating section 304, 
a procedure for determining the video image type in the 

25 video image type determining section 4, and a procedure 
for processing the video image in the video image 
processing section 5 are equivalent to those of the first 



- 36 - 

embodiment. 

In the present embodiment/ the terminal 40a transmits 
the video image, the direction and the position of the video 
image photographing device, and the speed information to 
5 the server 50a (the video image processing section 5, the 
landmark feature variable calculating section 204 and the 
moving feature variable calculating section 304) via the 
communication network 100. The server 50a calculates the 
landmark feature variable on the basis of the received 

10 direction and position of the video image photographing 
$ .device . The server 50a also calculates the moving feature 
variable on the basis of the received position of the video 
image photographing device and the speed information. 
The server 50a (the video image type determining 

15 section 4) determines the type of the video image on the 
basis of the landmark feature variable and the moving 
feature variable. The server 50a (the video image 
processing section 5) processes the received video image 
in accordance with the type of the video image. The server 

20 50a transmits a processed video image to the terminal 40a 
via the communication network 100. Accordingly, the 
terminal 40a (the display section 6) displays the received 
video image which is processed. 

In the present embodiment, the landmark information 

25 memory section corresponds to the landmark information 
memory device 203 of the server 50a. The route information 
memory section corresponds to the route information memory 
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device 303 of the server 50a. The server-side 
transmitting section corresponds to a control section and 
a network interface section of the server 50a. 

In the present embodiment , the video image input 
5 section corresponds to the video image obtaining section 
1 of the terminal 40a. The direction input section 
corresponds to the direction obtaining section 201 of the 
terminal 40a. The position input section corresponds to 
the position obtaining section 402 of the terminal 40a. 

10 The speed input section corresponds to the speed obtaining 
section 301 of the terminal 40a. The terminal-side 
transmitting section corresponds to the data processing 
unit and the network interface of the terminal 40a. The 
video image display section corresponds to the display 

15 section 6 of the terminal 40a. 

According to the present embodiment, a terminal 
carried by the person or mounted on the mobile means such 
as the vehicle, the ship and the aircraft obtains the video 
image, the photographing direction, the photographing 

20 position and the moving speed, and then, transmits them 
to the server. Therefore, it is possible to display the 
video image which is processed by a processing method 
corresponding to the video image scene and the usage 
purpose in the same manner with the first embodiment. 

25 (Third Embodiment) 

A third embodiment of the present invention will be 
explained below with reference to attached drawings. 
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Fig. 6 is a block diagram showing an example of a 
configuration of the video image processing system 
according to the present embodiment. As shown in Fig. 6, 
the video image processing system in the present embodiment 
5 includes a terminal 40b and a server 50b. The terminal 
40b and the server 50b are also connected via the 
communication network 100 as shown in Fig. 6. The 
communication network 100 in the present embodiment is a 
wireless communication network in the same manner with the 

10 second embodiment. 

The terminal 40b is a terminal carried by the person 
or mounted on the mobile means such as the vehicle, the 
ship and the aircraft. As shown in Fig. 6, the terminal 
40b includes the video image obtaining section 1, the 

15 direction obtaining section 201, the position obtaining 
section 402, the speed obtaining section 301, the video 
image processing section 5, and the display section 6. 

The video image obtaining section 1 is realized by 
a data processing unit (not shown) , a program and an input 

20 interface (not shown) of the terminal 40b. The direction 
obtaining section 201, the position obtaining section 402 
and the speed obtaining section 301 are also realized by 
the data processing unit, the program, the input interface 
and a network interface (not shown) of the terminal 40b. 

25 The video image processing section 5 is realized by the 
data processing unit, the program and the network interface 
of the terminal 40b. The display section 6 is also 
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realized by the data processing unit and a display device 
(not shown) of the terminal 40b. 

A procedure for obtaining the video image in the video 
image obtaining section 1, a procedure for obtaining the 
5 direction of the video image photographing device in the 
direction obtaining section 201, a procedure for obtaining 
the moving speed of the video image photographing device 
in the speed obtaining section 301, a procedure for 
processing the video image in the video image processing 

10 section 5, and a procedure for displaying the video image 
contents in the display section 6 are equivalent to those 
of the first embodiment. A procedure for obtaining the 
position of the video image photographing device in the 
position obtaining section 402 are also equivalent to the 

15 procedure for obtaining the position of the video . image 
photographing device in the position obtaining section 202 
and the position obtaining section 302 which were described 
in the first embodiment. 

The server 50b includes the landmark information 

20 memory device 203, the landmark feature variable 

calculating section 204, the route information memory 
device 303, the moving feature variable calculating 
section 304 and the video image type determining section 
4 as shown in Fig. 6. 

25 The landmark information memory device 203 and the 

route information memory device 303 are realized by, for 
example, the magnetic disc device. The landmark feature 
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variable calculating section 204, the moving feature 
variable calculating section 304 and the video image type 
determining section 4 are realized by an data processing 
unit (not shown) , a program and a network interface (not 
5 shown) of the server 50b. 

Contents of the landmark information memorized by the 
landmark information memory device 203 and the route 
information memorized by the route information memory 
device 303 are equivalent to those of the first embodiment. 

10 A procedure for calculating the landmark feature variable 
in the landmark feature variable calculating section 204, 
a procedure for calculating the moving feature variable 
in the moving feature variable calculating section 304, 
and a procedure for determining the type of the video image 

15 in the video image type determining section 4 are also 
equivalent to those of the first embodiment. 

In the present embodiment, the terminal 40b transmits 
exclusively the direction and the position of the video 
image photographing device and the speed information to 

20 the server 50b (the landmark feature variable calculating 
section 204 and the moving feature variable calculating 
section 304) via the communication network 100. The 
server 50b (the landmark feature variable calculating 
section 204) calculates a landmark feature variable on the 

25 basis of the received direction and position of the video 
image photographing device. The server 50b (the moving 
feature variable calculating section 304) also calculates 
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a moving feature variable on the basis of the received 
position of the video image photographing device and the 
received speed information. 

The server 50b (the video image type determining 
5 section 4) determines the type of the video image on the 
basis of the landmark feature variable and the moving 
feature variable. The server 50b then transmits a 
determination result of the type of the video image to the 
terminal 40b via the communication network 100. 

10 The terminal 40b (the video image processing section 

5) processes the video image which is obtained by the video 
image obtaining section 1 on the basis of the received 
determination result of the type of the video image. The 
terminal 40b (the display section 6) then displays the 

15 processed video image. 

In the present embodiment, the landmark information 
memory section corresponds to the landmark information 
memory device 203 of the server 50b. The route information 
memory section corresponds to the route information memory 

20 device 303 of the server 50b. The server-side 

transmission section corresponds to the data processing 
unit and the network interface of the server 50b. 

Furthermore, in the present embodiment, the video 
image input section corresponds to the video image 

25 obtaining section 1 of the terminal 40b. The direction 
input section corresponds to the direction obtaining 
section 201 of the terminal 40b. The position input 
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section corresponds to the position obtaining section 402 
of the terminal 40b. The speed input section corresponds 
to the speed obtaining section 301 of the terminal 40b. 
The terminal-side transmission section corresponds to the 
5 data processing unit and the network interface of the 
terminal 40b. The video image display section corresponds 
to the display section 6 of the terminal 40b. 

According to the present embodiment, the terminal 
carried by the person or mounted on the mobile means such 

10 as the vehicle, the ship and the aircraft obtains the 
photographing direction, the photographing position and 
the moving speed in order to transmit to the server. 
Therefore, the determination result of the video image 
scene can be obtained. Meanwhile, compared to a case (the 

15 second embodiment) of transmitting the server the video 
image in addition to the photographing direction, the 
photographing position and the moving speed, the amount 
of communication on the communication network is 
significantly reduce . 

20 (First Operational Example) 

An operational example of the video image processing 
system described in the first embodiment will be explained 
with reference to attached drawings. Fig. 7 is a flowchart 
showing the example of the operation of the video image 

25 processing system. The operational example of the video 
image processing system will be explained by using this 
flowchart . 
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The video image obtaining section 1 obtains and 
records a video image from the video image photographing 
device such as the CCD camera (step SI). The direction 
obtaining section 201 obtains the photographing direction 
5 of the video image photographing device, and the position 
obtaining section 202 obtains the photographing position 
of the video image photographing device (step S2) . The 
photographing direction obtained by the direction 
obtaining section 201 and the photographing position. 

10 obtained by the position obtaining section 202 are referred 
as "photographing information' 1 hereinafter. 

This operational example shows a case that the 
position obtaining section 202 is equivalent to the 
position obtaining section 302. Accordingly, the 

15 photographing position obtained in step S2 is not only used 
for obtaining a landmark feature variable, but also used 
for obtaining the moving feature variable in the moving 
feature variable obtaining section 3. 

The landmark feature variable obtaining section 2 

20 records the photographing information which is made to have 
relevance to the video image obtained by the video image 
obtaining section 1. When JPEG is used as a method for 
recording one frame of the video image, for example, the 
photographing information may be recorded in the header. 

25 An obtaining time may also be recorded as a time stamp in 
the video image and the photographing information. 
Therefore, a one to one correspondence is made between the 
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video image and the photographing information. 

The video image photographing device such as the 
video camera records about 30 frames of the video image 
for one second in general. However, it is difficult for 
5 the GPS and the like to obtain the position information 
(latitude and longitude) more than once every second. 
Therefore, the current position information may be 
estimated by performing a correction of the immediate 
position information using the moving direction and speed. 

10 When the obtaining of the video image and the obtaining 
of the position information can be simultaneously 
performed in real time, it is not necessary to synchronize 
the time information. 

The landmark feature variable calculating section 

15 204 extracts and obtains the landmark information stored 
in the landmark information memory device 203 (step S3) . 
Here, each landmark is regarded as Oi ( i = 1 to N) . The 
landmark is defined as a polygonal pillar having K number 
of apexes, wherein the position of the respective apexes 

20 is expressed as (x, y, z) by using the longitude, the 
latitude and the height. In this case, the k-th upper-side 
apex of the landmark Oi is expressed as (OiLon^, C^Lat^, h t ) . 

The landmark feature variable calculating section 
204 calculates the landmark feature variable on the basis 

25 of the photographing position, the photographing 

direction, the landmark position and the viewing angle 
which is obtained in advance (step S4). As the landmark 
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feature variable, this operation example employs a 
landmark position on the screen (LF1), a landmark size on 
the screen (LF2), a ratio of the landmark shown on the 
screen (LF3) , and a number of the landmark existing within 
5 the viewing angle (LFO). A procedure will be explained 
below to calculate the landmark feature variable in the 
landmark feature variable calculating section 204. 

The landmark feature variable calculating section 
204 converts the relative position of the each landmark 

10 Oi (i = 1 to N) observed from the photographing position 
into the camera viewing angle. Therefore, the landmark 
is determined whether or not to exist within the viewing 
angle, and the position and the size of the landmark on 
the screen are calculated. The conversion into the camera 

15 viewing angle means to calculate where the landmark is 
displayed on the screen. 

As a preprocessing, the landmark feature variable 
calculating section 204 selects a landmark with a 
possibility of existing within the viewing angle among the 

20 landmarks corresponding to all the landmark information 
stored in the landmark information memory device 203. The 
landmark feature variable calculating section 204 then 

* 

performs a conversion process into the camera viewing angle 
with respect to the selected landmark. 
25 It is assumed that the latitude and longitude of the 

photographing position in the current frame is (CarLon, 
CarLat), the photographing direction is dir and the apex 
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number of a polygon of the landmark is K = 4 . A procedure 
for determining whether or not the landmark exists within 
the viewing angle will be explained below by using figures. 
In this example, the photographing direction is expressed 
5 by an angle which is rotating clockwise with the north of 
0 degree. 

Fig. 8 is a diagram to explain a process of determining 

* 

whether or not the landmark exists within the horizontal 
viewing angle. The landmark feature variable calculating 

10 section 204 employs the following equation (1) to obtain 
an angle difference diff k between a moving direction 
(photographing direction) and a direction ObjDir k from the 
photographing position to the respective apexes of the 
landmark Oi (landmark A in this example). 

15 [Equation 1] 

diff k =ObjDir k -dir(k = \~4) ..-(1) 

The landmark feature variable calculating section 
204 employs the following equation (2) to determine whether 
or not the angle difference dif f k which is obtained by using 

20 the equation (1) is within the viewing angle. As shown 
in Fig. 8, for example, if a horizontal camera viewing angle 
CameraAngleH is 50 degrees, the angle difference diff k 
should be within ± 25 degrees so that the angle difference 
diff k is within the viewing angle. 

25 [Equation 2] 

Wfk I < -CameraAngleH • - • (2) 
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Fig. 9 is a diagram to explain a process of determining 
whether or not the landmark exists within the vertical 
viewing angle. The landmark feature variable calculating 
section 204 employs the following equation (3) to calculate 
5 a look-up angle lookupi from the photographing position 
to the landmark apex on the basis of a distance disti from 
a photographing position to the landmark and a height hi 
of the landmark. 



10 



[Equation 3] 



/ U \ 

lookup i = tan * 



(3) 



The landmark feature variable calculating section 
204 employs the following equation (4) to determine whether 
or not the angle lookupi which is obtained by using the 
equation (3) is within the viewing angle. For example, 

15 a vertical camera viewing angle CameraAngleV is assumed 
to be 38 degree as shown in Fig. 9. When the angle lookupi 
satisfies the equation (4) , the landmark feature variable 
calculating section 204 determines a possibility that the 
whole landmark is displayed. 

20 [Equation 4] 

lookup i < — CameraA ngle V • - • (4) 

The direction ObjDir k from the photographing 
position to the each apex of the landmark Oi and distance 
dist t from the photographing position to the landmark are 
25 employed in the above equations (1) to (4), here, the 
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distance and the direction between the two points can be 
obtained by the following method. 

We assume the coordinates of a measurement point 1 
as (x lt yj and coordinates of a measurement point 2 as (x 2/ 
5 y 2 ) . We also assume the average curvature radius as R 0 and 
the scaling factor in the origin of the coordinate system 
as m 0 . In this case, the geodesic line length S between 
the two points is obtained by the following equation (5) . 
[Equation 5] 
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S = 

s 

S 

f = »0< 



> 



(5) 



A directional angle T x of the measurement point 2 in 
the measurement point 1 and a directional angle T 2 of the 
measurement point 1 in the measurement point 2 are obtained 
by the following equation (6). 
15 [Equation 6] 



7i='i-('i-ri) 
T 2 =t 2 -{t 2 -T 2 ) 

t x = tan" 1 



X 2 ~ X l 



t 2 = t x +180' 



...(6) 



Calculation formulae which were indicated in the 
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equation (5) and the equation (6) are described in the 
homepage of the Geographical Survey Institute in Japan 
(http : //vldb . gsi . go . jp/sokuchi/surveycalc/algorithm/xy 
2st/xy2st . htm) . 
5 The landmark feature variable calculating section 

204 is capable of determining whether or not the landmark 
Oi exists within the viewing angle by determining whether 
or not an apex k satisfying the equation (2) exists in 
accordance with the above procedures. The landmark 

10 feature variable calculating section 204 can also 
determine whether the landmark Oi exists on the right side 
or the left side of the video image by a sign (+ or -) of 
the angle difference diff k with respect to the apex k. 
Moreover, the landmark feature variable calculating 

15 section 204 can determine whether the whole landmark exists 
within the viewing angle or a part of the landmark exceeds 
the viewing angle by depending on whether or not all the 
apexes k satisfy the equation (2) and the equation (4). 
The landmark feature variable calculating section 

20 204 calculates the position and size of the landmark on 
the screen exclusively for the landmark Oi which satisfies 
the equation (2) and the equation (4). The landmark 
feature variable calculating section 204 calculates the 
position (x k , y k ) on the screen for the respective apexes 

25 k (= 1 to 4) of the landmark Oi existing within the viewing 
angle. The landmark feature variable calculating section 
204 then extracts circumscribed rectangles (x min , y min ) to 
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( x max' ymaJ including these apexes by using the following 
equation (7). In the equation (7), "Min" is a function 
to extract the minimum value, and "Max" is a function to 
extract the maximum value. 
5 [Equation 7] 

*min =Min(x l9 x 29 x^x 4 ) 
y mtn =Min(y } ,y 2 ,y 3> y 4 ) 

y mBK =Max(y u y 2> y 3 ,y 4 ) --(7) 

The landmark feature variable calculating section 
204 also obtains the position (x, y) of a point P on the 
screen which corresponds to the angle difference diff and 

10 the angle lookup. Fig. 10 is a diagram to explain a process 
of obtaining the position (x, y) of the point P on the screen. 
It is assumed that the screen has, for example, 640 * 480 
pixels. The landmark feature variable calculating 
section 204 obtains the position (x, y) of the point P on 

15 the screen by using the following equation (8). 
[Equation 8] 

x =320+320 [pixel] 

CameraAngleH 

y = 240 + 240 [pixel] ...(8) 

CameraAngleV 

Next, the landmark feature variable calculating 
section 204 calculates the ratio and size of the landmark 
20 which is displayed within the viewing angle. The landmark 
feature variable calculating section 204 obtains the size 
Size of the whole landmark including the area outside the 
viewing angle by using the following equation (9). The 
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landmark feature variable calculating section 204 also 
obtains the size Size' of the portion of the landmark which 
is displayed within the viewing angle by using the equation 
(10) . 
5 [Equation 9] 

Size = ( X max - *mi» ) "^rain) - (9) 

[Equation 10] 

Size ' = (*max' - *min' ) (iW ~ ^min' ) 

'y(* ma x>640) then * max '=640 
'/(>W>480) then y m J =480 

<0) then x ma l =0 
'/(^i„<0) then y min '=0 -..(10) 

The landmark feature variable calculating section 
10 204 also calculates the ratio Pt of the landmark which is 
displayed within the viewing angle by using the following 
equation ( 11 ) . 
[Equation 11 ] 

n Size* 

15 The landmark feature variable calculating section 

204 calculates the landmark feature variables (LF1, LF2, 
LF3) for the respective landmarks. In this case, the 
landmark feature variable calculating section 204 may use 

( x min/ v min> Xmax> V max ) as the feature variable LFli of the 
20 position of the landmark Oi . For simplification, the 

landmark feature variable calculating section 204 may use 

m i n ^ max )/2, (y min + y ma x)/2) by using the center 
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point of the landmark Oi . 

The landmark feature variable calculating section 
204 determines the landmark feature variables LF2 and LF3 
of the landmark Oi as LF2 i = Size and LF3i = Pt, respectively. 
5 The landmark feature variable calculating section 

204 also obtains the number of the landmarks which are 
determined as existing within the viewing angle. The 
landmark feature variable calculating section 204 obtains 
the number of the landmarks satisfying the equation (2) 

10 and the equation (4) as the landmark feature variable LFO. 

The landmark feature variable calculating section 
204 may obtain, as the other landmark feature variables, 
a genre of the landmark (LF4), a name recognition level 
of the landmark (LF5) and the accumulated time of 

15 displaying the identical landmark. 

The moving feature variable calculating section 304 
obtains the moving speed by the input from the speed 
obtaining section 301 (step S5) . The speed obtaining 
section 301 obtains the moving speed of the video image 

20 photographing device from a speed mater or the car 

navigation device in the case of the car for example. The 
moving feature variable calculating section 304 may obtain 
the moving speed by performing a time-differentiation of 
the positions of the video image photographing device which 

25 are successively obtained by the position obtaining 
section 302 . 

The moving feature variable calculating section 304 
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obtains route information stored in the route information 
memory device 303 (step S6) . The moving feature variable 
calculating section 304 extracts, as the route information, 
the dot series of the longitude/ latitude, the road type 
5 (public road or private road) , the road width, the number 
of the lanes, the existence of the intersection, the 
existence of the signal and the limited speed. In this 
case, the moving feature variable calculating section 304 
extracts the route information corresponding the vicinity 

10 of the moving route of the video image photographing device 
among the route information stored in the route information 
memory device 303 on the basis of the photographing 
position obtained. in the above step S2 . 

The moving feature variable calculating section 304 

15 calculates the moving feature variable on the basis of the 
position of the video image photographing device, the 
moving speed and the route information (step S7) . In this 
case, the moving feature variable calculating section 304 
employs the photographing position (moving position) of 

20 the video image photographing device which is obtained in 
step S2. In this operational example, the running state 
(DF1), the straightness (DF2) and the side trip feature 
variable (DF3) are employed as the moving feature variable . 
The moving feature variable calculating section 304 

25 obtains the running state feature variable DF1 by using 
the route information, a moving speed Sp [km/hour] and a 
limited speed LS [km/hour] with the following procedures. 
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It is assumed in the moving feature variable calculating 
section 304 that the running state is "stop" if the moving 
speed SP is 0, the running state is "low speed" if the Sp 
is (LS - 10) or lower, and the running state is "normal" 
5 if the Sp is (LS - 10) or more. The stop state is expressed 
as WDF1 = 0, the low-speed running state is expressed as 
WDF1 = 1, and the normal running state is expressed as WDF 
= 2. 

When the condition of 11 inter sect ion = nonexistent or 

10 existent", "signal = existent" and "WDF = 0" is satisfied, 
for example, the moving feature variable calculating 
section 304 determines the feature variable DF1 as "DF1 
= 0". Meanwhile, when the condition of "intersection = 
nonexistent or existent", "signal = nonexistent" and "WDFl 

15 = 0" is satisfied, the moving feature variable calculating 
section 304 determines the feature variable DF1 as "DFl 
= 1". In the other cases, the moving feature variable 
calculating section 304 determines the feature variable 
DFl as "DFl = 2". 

20 The moving feature variable calculating section 304 

also calculates the straightness DF2 . The moving feature 
variable calculating section 304 calculates the 
straightness by using the photographing position of the 
current frame and the photographing position in a frame 

25 before having predetermined regular intervals. Fig. 11 is 
a diagram to explain a calculation method of the 
straightness. Fig. 11 shows a locus of the photographing 
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positions (PI to P5) for up to the past 5 seconds including 
a notice frame (current frame) . 

The moving feature variable calculating section 304 
calculates the speed vectors VI to V4 by a car position 
5 (photographing positions) of five points PI to P5 which 
are obtained every one second. The size of an angle made 
by the obtained speed vectors is defined as a rectilinear 
factor direct. At this time, the moving feature variable 
calculating section 304 calculates the rectilinear factor 
10 direct by using the following equation (12) . 
[Equation 12] 



When the intersections are apart and the rectilinear 
factor is small, the moving feature variable calculating 

15 section 304 determines that the car is in the state of 
driving a curb and sets the feature variable DF2 at an 
intermediate value. Moreover, when the rectilinear 
factor is small and the intersections are close, the moving 
feature variable calculating section 304 determines that 

20 the car is turning right or left and sets the feature 
variable DF2 at a large value. In the other cases, the 
moving feature variable calculating section 304 sets the 
feature variable DF2 at a small value. 



25 value thresdir is set in advance. The moving feature 
variable calculating section 304 sets the feature variable 





For example, we assume that a predetermined threshold 
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DF2 as DF2 = 2 when the condition of "direct < thresdir" 
and "intersection = nonexistent" is satisfied. The moving 
feature variable calculating section 304 also sets the 
feature variable DF2 as DF2 = 3 when the condition of 
5 "direct < thresdir" and "intersection = existent" is 
satisfied. In the other cases, the moving feature 
variable calculating section 304 establishes the feature 
variable DF2 as DF2 = 1. 

The moving feature variable calculating section 304 

10 calculates the side trip feature variable DF3 on the basis 
of a route deviation variable Rd between the current 
position of the video image photographing device and the 
guidance route of .the car navigation, and the existence 
of the intersection. The moving feature variable 

15 calculating section 304 may obtain the route deviation 
variable Rd itself as a moving feature variable. 

For example, we assume that a predetermined threshold 
value thresRd is set in advance. The moving feature 
variable calculating section 304 determines the feature 

20 variable DF3 as DF3 = 1 when the condition of "Rd < thresRd" 
and "intersection = nonexistent or existent" is satisfied. 
The moving feature variable calculating section 304 also 
determines the feature variable DF3 as DF3 = 2 when the 
condition of "Rd > thresRd" and "intersection = existent" 

25 is satisfied. The moving feature variable calculating 
section 304 further determines the feature variable DF3 
as DF3 = 3 when the condition of "Rd > thresRd" and 
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"intersection = nonexistent" is satisfied. The moving 
feature variable calculating section 304 calculates the 
route deviation variable Rd by using the following equation 
(13) . 
5 [Equation 13] 

Rd=Min(dist(x,y 9 Rd xi Rd y )) —(13) 

In the equation (13), x, y are the longitude and 
latitude to indicate the photographing position, and Rd x , 
Rd y are the longitude and latitude of one point for 

10 configuring the guidance route in the navigation system. 
Furthermore, Min is a function to extract the minimum value 
in the equation (13). 

The moving feature variable calculating section 304 
outputs the moving feature variables = (DF1, DF2, DF3) 

15 which were obtained in accordance with the above 
procedures . 

The moving feature variable calculating section 304 
may employ a variable indicating the change of the road 
size as a moving feature variable DF4 in addition to the 

20 above DF1, DF2 and DF3 . For example, we consider the case 
that "value 2" is allocated to the public road and "value 
1" is allocated to the private road. When the car moved 
into the private road from the public road, the moving 
feature variable calculating section 304 calculates DF4 

25 = -1 as the moving feature variable DF4 . Also, when the 
car moved into the private road from the private road, the 
moving feature variable calculating section 304 
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calculates DF4 = 0 as the moving feature variable DF4 . 
Moreover, when the car moved into the public road from the 
private road, the moving feature variable calculating 
section 304 calculates DF4 = 1 as the moving feature 
5 variable DF4 . 

Next, the video image type determining section 4 
determines the type of the video image contents on the basis 
of the landmark feature variable and the moving feature 
variable (step S8). In this operational example, the 

10 video image type determining section 4 determines the type 
of the video image contents by classifying the video image 
scenes into categories. In order to classify the video 
image scenes into the categories, the video image type 
determining section 4 performs a process explained below 

15 for the respective video image scenes. In this example, 
it is shown a case in which the running state (DF1) and 
the straightness (DF2) are employed as the moving feature 
variable, and the number of the landmarks (LFO) existing 
within the viewing angle is employed as the landmark 

20 feature variable. 

In this operational example, the video image type 
determining section 4 determines " corner /j unction point 
category" in the case of DF2 = 3, "traffic congestion 
category" in the case of DF1 = 1, "signal waiting category" 

25 in the case of DF1 = 0 as the video image category. The 
video image type determining section 4 also determines 
"landmark category" as the video image category in the case 
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other than LFO = 0. Furthermore, in the case of meeting 
none of these conditions/ the video image type determining 
section 4 determines "other category" as the video image 
category. The video image type determining section 4 
5 outputs the determined category. The video image type 
determining section 4 may classify one video image scene 
into one category, and one video image scene into a 
plurality of categories. 

In this operational example, the case to determine 

10 the type of the video image scene is explained by using 
the moving feature variables DF1 and DF2 along with the 
landmark feature variable LFO. However, the method for 
determining the type of the video image scene is not limited 
to this case. For example, the video image type 

15 determining section 4 may determine the type of the video 
image scene as the landmark feature variable by using LFO 
to LF3. In this case, the video image type determining 
section 4 classifies "whole landmark scene" in the case 
of displaying the whole landmark within the screen, "front 

20 landmark scene" in the case of displaying the landmark in 
the screen center, "enlarged landmark scene" in the case 
of displaying the landmark on a large scale within the 
screen, and the like. 

For example, the video image type determining section 

25 4 may select "whole landmark scene" if "LFO # 0 and LF3 
> 0.9". If "LFO # 0 and I LF1 coordinates (x, y) - screen 
center coordinates I < predetermined threshold value" , the 
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video image type determining section 4 may select "front 
landmark scene". If 11 LFO ? 0 and LF2 > predetermined 
threshold value", "enlarged landmark scene" may be 
selected. The video image type determining section 4 may 
5 also classify the respective video image scenes into, for 
example, "mountain scene", "building scene" and "famous 
landmark scene" by further employing the landmark feature 
variables LF4 and LF5. 

The threshold value for the respective moving feature 

10 variables and the respective landmark feature variables 
may be changed depending on the usage purpose. The video 
image type determining section 4 may determine the type 
of the video image scene by changing the threshold value 
for the usage purpose. 

15 The video image processing section 5 extracts a video 

image processing method applied to the video image scene 
on the basis of the type (category) of the video image scene 
determined in step S8 and the usage purpose specified by 
the user in accordance with a predetermined rule. Fig. 12 

20 shows an example of setting information (rule) with regard 
to the video image processing method. In this operational 
example, the video image processing section 5 includes the 
memory device, wherein the setting information indicated 
in Fig. 12 is memorized in the memory device in advance. 

25 The video image processing section 5 extracts the video 
image processing method in accordance with the setting 
information indicated in Fig. 12. The setting information 
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indicated in Fig. 12 can be renewed by the input of the user. 

The video image processing section 5 sets a video 
image processing method as follows in accordance with the 
rule indicated in Fig. 12. For example, when the type of 
5 the video image is the landmark scene (landmark category) 
and the usage purpose is the grasp of the route, the video 
image processing section 5 selects "with ticker" as the 
processing method. Moreover, when the type of the video 
image is a cornering scene (turning corner/ junction 

10 category) and the usage purpose is the grasp of the route, 
the video image processing section 5 selects "slow replay" 
and "guidance instruction display" as the processing 
method. Furthermore, when the type of the video image is 
a stop scene (traffic congestion category or signal waiting 

15 category) and the usage purpose is the grasp of the route, 
the video image processing section 5 selects "skip (scene 
cut)" as the processing method. 

Meanwhile, when the type of the video image is the 
other unimportant scene (other category) and the usage 

20 purpose is the grasp of the route, the video image 
processing section 5 selects "fast-forwarding replay 
(high-speed replay)" as the processing method. When the 
type of the video image is the other unimportant scene and 
the usage purpose is sightseeing, the video image 

25 processing section 5 selects "scene cut" as the processing 
method . 

The video image processing section 5 processes the 
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video image in accordance with the selected processing 
method (step S9) . In the case of performing the slow 
replay processing, the video image processing section 5 
inserts an interpolated frame between video image frames 
5 in accordance with the slow replay magnification. For 
example; when the slow replay magnification is double, the 
video image processing section 5 inserts the interpolated 
frame between the successive first frame and the second 
frame. In this case, the video image processing section 

10 5 is capable of making the interpolated frame by obtaining 
the average of pixel values of both frames. 

In the case of processing with ticker, the video image 
processing section 5 superimposes the name of the landmark 
which possibly exists within the viewing angle. The video 

15 image processing section 5 performs a processing so as to 
display the ticker in the middle above the landmark 
existing area without covering the displayed landmark. 
When the ticker shows the route instruction information, 
the video image processing section 5 also performs a 

20 processing to display the ticker on the screen center. 
When the landmark existing area is overlapped in the 
display space, the video image processing section 5 

* 

performs a processing to display the ticker in the middle 
between the lower side of the landmark existing area and 
25 bottom end of the screen. The ticker can be thereby 
superimposed on the road area without covering the 
landmark . 
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In the case of performing the scene cut processing, 
the video image processing section 5 performs the 
processing by skipping the frame. In the case of 
performing the high-speed replay processing, the video 
5 image processing section 5 thins a frame out among the front 
and behind frames based on high-speed magnification. In 
the case of the double speed, for example, the video image 
processing section 5 performs a double-speed replay by 
skipping the second frame in the successive two frames. 

10 When the ticker of the landmark name, the landmark 

incidental information and the route instruction 
information are superimposed on the video image, the amount 
of the information on the screen is increased. Therefore, 
there is the case that the user has a difficulty of grasping 

15 the information when the high-speed replay or the 

normal-speed replay is performed. Hence, the replay speed 
may be set as slow by depending on the amount of the 
information superimposed on the video image . For example, 
the video image processing section 5 may set the replay 

20 speed on the basis of the following equation (14) . 

"Replay Speed" = "Initial Setting Replay Speed" / (1 
+ "Weighting Parameter" * "Number of Characters" * 
"Distance between Words"). (14) 

The video image processing section 5 determines 

25 whether or not the determination process is completed with 
respect to all the video image frames (step S10). When 
there is a frame whose determination process is not 
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completed, the video image processing system repeats to 
perform the processing of step SI and the following steps 
with respect to the unprocessed frame. When the 
determination process is performed for all the frames, the 
5 video image processing section 5 outputs a group of the 
frames which is generated by the processing treatment. 
The video image processing section 5 may process and output 
exclusively a certain-type video image scene in accordance 
with the determined processing method. 
10 The display section 6 replays the outputted group of 

the frames for displaying the video image (step Sll). 

* 

Fig. 13 shows an example of displaying the video image in 
the display section 6. As shown in Fig. 13, the display 
section 6 displays the video image to be replayed by 

15 synchronizing with a map in the vicinity of the 

photographing position. Meanwhile, the display screen 
includes a usage selection button 1200 and the like as the 
user interface in which the usage purpose of the user (e.g., 
drive route simulation and sightseeing drive guidance) can 

20 be specified to input. 

(Second operational example) 

A second operational example of the video image 
processing system indicated in the first embodiment will 
be explained with reference to attached drawings. Fig. 14 

25 is a flowchart showing an operational example of the video 
image processing system. An operational example of the 
video image processing system will be explained by using 
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this flowchart . 

As shown in Fig. 14, an importance level determination 
process is performed in this operational example in 
addition to the respective processes described in the first 
5 operational example. The newly added importance level 
determination process (step S7b) will be explained below. 
The processes other than the importance level 
determination process are equivalent to those described 
in the first operational example. 

10 The video image type determining section 4 calculates 

a landmark scene importance level fj by using the landmark 
feature variables ( LF1 , LF2 and LF3) . The landmark scene 
importance level f 1 indicates the importance level with 
regard to the landmark in the video image scene which is 

15 the object for processing. The video image type 

determining section 4 also calculates a drive information 
scene importance level f d by using the moving feature 
variables (DF1, DF2 and DF3) . The drive information scene 
importance level f d indicates the importance level with 

20 respect to the driving in the video image scene which is 
the object for processing. 

The video image type determining section 4 obtains 
the landmark importance f l by the sum of the product between 
the feature variable in the respective landmarks and a 

25 weighting parameter as expressed in the following equation 
(15). The video image type determining section 4 also 
obtains the drive information scene importance level f d 
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by the product of the respective factors (feature variables 
and weighting parameters) as expressed in the following 
equation (16) . In this operational example, LF1, LF2 and 
LF3 are employed as the landmark feature variables, and 
5 DF1 and DF2 are employed as the moving feature variables. 
[Equation 15] 

No 

fl = Yj W LF\ dist ( LF ^xi^ LFl yi^ 

.W^LFlrW^LF^ ...(15) 

[Equation 16] 

fd =W DPX DF\-W DP2 DF2 -(16) 

In the equation (15), dist (LF1, DispCenter) is a 
function to obtain the distance (pixel) between LF1 (= 
(LFlx, LFly) ) and the screen center (DispCenterX, 
DispCenterY) as expressed in the following equation (17) . 
[Equation 17] 

dist = ^(DispCenterX - LF\ X f + (DispCenterY - LF\ y ) 2 -.-(17) 



10 



15 

The weighting parameters of the respective feature 
variables W LFi (i = 1 to 3) and W DFi (i = 1, 2) are determined 
in accordance with the following rules. Specifically, the 
weight is determined so as to have a higher importance level 
20 in the smaller straightness at the intersection. The 
weight is also determined so as to have a lower importance 
level in the lower moving speed at the intersection. The 
weight is also determined so as to have a higher importance 
level in the higher side trip level. The weight is also 
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determined to have a higher importance level in the larger 
size difference of the road in turning right/left. 

The weight is also determined so as to have a higher 
importance level in the case of the whole landmark largely 
5 displayed on the screen center. The weight is also 

determined so as to have a higher importance level for the 
landmark with the higher name recognition level. The 
weight is also determined so as to have a higher importance 
level for the landmark with the higher stability level 

10 (less blurring on the screen). The weight is also 

determined so as to have a lower importance level for the 
landmark which has been already displayed. The weight is 
also determined so as to have a higher importance level 
in the larger number of the landmark. The weight is also 

15 determined so as to have a higher importance level for the 
longer displayed landmark. 

The video image type determining section 4 determines 
the comprehensive importance level of the video image scene 
by using the landmark scene importance level f x and the 

20 drive information scene importance level f d . This 

comprehensive importance level of the video image scene 
is referred hereinafter as a comprehensive importance 
level ft. The video image type determining section 4 may 
obtain the comprehensive importance level ft in accordance 

25 with the distribution ratio which is determined in advance 
between the landmark scene and the drive information scene. 
The video image type determining section 4 may also obtain 
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the comprehensive importance level ft in accordance with 
the distribution ratio which is determined by the user by 
corresponding to the customize axis (to be explained below) . 
The video image type determining section 4 determines the 
5 comprehensive importance level ft in the video image scene 
by using the following equation (18) and the equation (19) . 
[Equation 18] 

ft= W J x +W d f d ...(18) 

[Equation 19] 

io ^i+^=l -09) 

According to this operational example, the video 
image scene having the comprehensive importance level ft 
which is larger than a predetermined threshold value which 
is specified in advance is selected as an important scene 

15 and used as an object for the video image processing. To 
be more specific, the video image type determining section 
4 determines whether or not the comprehensive importance 
level ft is larger than the predetermined threshold value 
(step S7b) . When the comprehensive importance level ft 

20 is determined as larger than the predetermined threshold 
value, the video image type determining section 4 performs 
the video image type determination process for the video 
image scene (step S8) . When the comprehensive importance 
level ft is determined as smaller than the predetermined 

25 threshold value, the video image processing system repeats 
to perform the processes of step SI and the following steps. 
Fig. 15 is a diagram to explain a method for 
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determining a weighting distribution of a calculation by 
a customize axis which is setby the user. As show in Fig . 15, 
the user adjusts the customize axis in order to freely set 
the level (comprehensive weighting ratio) between the 
5 route simulation purpose and the sightseeing drive purpose . 
In other words, the weight between the route simulation 
purpose and the sightseeing drive purpose can be changed 
in accordance with the usage purpose of the user. 
Accordingly, it is possible to determine the importance 

10 level which is applicable to the respective usage purposes. 

As the user interface to determine the usage purpose 
of the user (e.g., drive route simulation and sightseeing 
drive guidance) , slide bar may be employed. Fig. 16 shows 
another example of the display screen. As shown in Fig. 16, 

15 the display screen may include a switching slide bar 1500 . 
in order to set the usage purpose. 

The video image processing system according to the 
present invention is applicable to the purposes including, 
for example, a drive route simulation system such as the 

20 car navigation and a program to realize the drive route 
simulation. The video image processing system according 
to the present invention is also applicable to the purposes 
including an automatic digest system to effectively browse 
the video image contents and a program to realize an 

25 automatic digest. 



